Skip to content

Add v1.3 release notes. #344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
ftian1 merged 18 commits into from
Apr 25, 2025
Merged

Add v1.3 release notes. #344

ftian1 merged 18 commits into from
Apr 25, 2025

Conversation

@joshuayao
Copy link
Collaborator

@joshuayao joshuayao commented Apr 2, 2025 •
edited
Loading

Add v1.3 release notes.

@joshuayao joshuayao requested review from hshen14 and kding1 April 2, 2025 08:54
@joshuayao joshuayao added this to OPEA Apr 9, 2025
@joshuayao joshuayao added this to the v1.3 milestone Apr 9, 2025
@joshuayao joshuayao added WIP documentation Improvements or additions to documentation labels Apr 9, 2025
@joshuayao joshuayao moved this to In progress in OPEA Apr 9, 2025
@joshuayao joshuayao marked this pull request as ready for review April 9, 2025 08:23
@joshuayao joshuayao removed the WIP label Apr 9, 2025
@joshuayao joshuayao moved this from In progress to In review in OPEA Apr 9, 2025
@joshuayao joshuayao added the v1.3 label Apr 10, 2025
@joshuayao joshuayao requested a review from Copilot April 11, 2025 07:26
Copilot AI reviewed Apr 11, 2025
View reviewed changes
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (2)

release_notes/v1.3.md:2

  • The TODO placeholder for the number of pull requests may confuse users. Consider updating this placeholder with the final count before release.
We are excited to announce the release of OPEA version 1.3, which includes significant contributions from the open-source community. This release addresses over 400(TODO: the number is subject to change) pull requests.

release_notes/RELEASE.md:18

  • [nitpick] The date format seems inconsistent with other entries (e.g., using 'Apr' instead of 'July'). Consider standardizing abbreviations to maintain consistency in the release schedule.
| 1.4     | July 2025    |

@joshuayao joshuayao linked an issue Apr 14, 2025 that may be closed by this pull request
[Task] Deprecate ChatHistory, Feedback Management, and prompt management microservices --> OPEA Store opea-project/GenAIComps#1548
Closed
mkbhanda
mkbhanda reviewed Apr 21, 2025
View reviewed changes
Copy link
Collaborator

@mkbhanda mkbhanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does AMD want to add to the table of supported models on serving frameworks and hardware?
Arc not mentioned in table, do we want to add?

louie-tsai
louie-tsai reviewed Apr 21, 2025
View reviewed changes
ashahba
ashahba requested changes Apr 21, 2025
View reviewed changes
Yu-amd
Yu-amd suggested changes Apr 21, 2025
View reviewed changes
Copy link
Contributor

@Yu-amd Yu-amd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD team has a validated model matrix we can provide.

@Yu-amd
Copy link
Contributor

Yu-amd commented Apr 22, 2025 •
edited
Loading

AMD team has a validated model matrix we can provide.
| Model | TGI-Gaudi | vLLM-CPU | vLLM-Gaudi | vLLM-ROCm | OVMS | Optimum-Habana | PredictionGuard |
| ------------------------------------------- | --------- | -------- | ---------- | --------- | -------- | -------------- | --------------- |
| deepseek-ai/DeepSeek-R1-Distill-Llama-8B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/DeepSeek-R1-Distill-Llama-70B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-7B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-14B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-32B | ✓ | - | ✓ | ✓ | - | ✓ | - |
| deepseek-ai/Deepseek-v3 | ✓ | - | ✓ | ✓ | - | ✓ | - |
| Hermes-3-Llama-3.1-8B | - | - | - | ✓ | - | - | ✓ |
| ibm-granite/granite-3.2-8b-instruct | - | - | ✓ | ✓ | - | | - |
| Phi-4-mini | x | x | x | ✓ | x | ✓ | - | | Phi-4-multimodal-instruct | x | x | x | ✓ | x | ✓ | - |
| mistralai/Mistral-Small-24B-Instruct-2501 | ✓ | - | ✓ | ✓ | - | ✓ | - |
| mistralai/Mistral-Large-Instruct-2411 | x | - | ✓ | ✓ | - | ✓ | -
|
Phi-4-mini works with latest docker image: rocm/vllm:rocm6.3.1_instinct_vllm0.8.3_20250410

ROCm_Model_matrix

@joshuayao Please see the table above, which includes a column of validated models on ROCm.

Thanks!

ashahba
ashahba approved these changes Apr 22, 2025
View reviewed changes
Copy link
Collaborator

@ashahba ashahba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

rbrugaro
rbrugaro suggested changes Apr 22, 2025
View reviewed changes
eero-t
eero-t suggested changes Apr 22, 2025
View reviewed changes
@joshuayao
Copy link
Collaborator Author

joshuayao commented Apr 23, 2025

AMD team has a validated model matrix we can provide.

Model TGI-Gaudi vLLM-CPU vLLM-Gaudi vLLM-ROCm OVMS Optimum-Habana PredictionGuard
deepseek-ai/DeepSeek-R1-Distill-Llama-8B ✓ - ✓ ✓ - ✓ -
deepseek-ai/DeepSeek-R1-Distill-Llama-70B ✓ - ✓ ✓ - ✓ -
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B ✓ - ✓ ✓ - ✓ -
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B ✓ - ✓ ✓ - ✓ -
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B ✓ - ✓ ✓ - ✓ -
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B ✓ - ✓ ✓ - ✓ -
deepseek-ai/Deepseek-v3 ✓ - ✓ ✓ - ✓ -
Hermes-3-Llama-3.1-8B - - - ✓ - - ✓
ibm-granite/granite-3.2-8b-instruct - - ✓ ✓ - -
Phi-4-mini x x x ✓ x ✓ -
mistralai/Mistral-Small-24B-Instruct-2501 ✓ - ✓ ✓ - ✓ -
mistralai/Mistral-Large-Instruct-2411 x - ✓ ✓ - ✓ -

|
Phi-4-mini works with latest docker image: rocm/vllm:rocm6.3.1_instinct_vllm0.8.3_20250410

ROCm_Model_matrix @joshuayao Please see the table above, which includes a column of validated models on ROCm.

Thanks!

Hi @Yu-amd Updated. Thanks for your information.

Yu-amd
Yu-amd approved these changes Apr 23, 2025
View reviewed changes
Copy link
Contributor

@Yu-amd Yu-amd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you.

eero-t
eero-t reviewed Apr 23, 2025
View reviewed changes
Copy link
Contributor

@eero-t eero-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I had typos in my suggestions.

@joshuayao @eero-t
v.1.3 release notes: apply suggestions from Eero
0ca9c97 
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
@joshuayao
Copy link
Collaborator Author

joshuayao commented Apr 25, 2025

Sorry, I had typos in my suggestions.

No problem. Thanks for the updates.

@joshuayao joshuayao requested a review from eero-t April 25, 2025 04:44
eero-t
eero-t reviewed Apr 25, 2025
View reviewed changes
Copy link
Contributor

@eero-t eero-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess "Other Notable Changes" section content came directly from the PR titles, but for the release notes I think it would good to use correct & consistent capitalization for the names (and maybe also monotype for function names).

Following terms seemed to have instances with incorrect capitalization:

  • AgentQnA
  • Dataprep
  • DeepSeek
  • Docker
  • Helm
  • LlamaGuard
  • LVM
  • Milvus
  • MySQL
  • OpenAI
  • PubMed
  • Python
  • RAG
  • TEI
  • vLLM
  • Xeon
  • YAML

@joshuayao @eero-t
Update release_notes/v1.3.md
805d644 
Co-authored-by: Eero Tamminen <eero.t.tamminen@intel.com>
@ftian1 ftian1 merged commit 3f931d7 into opea-project:main Apr 25, 2025
4 checks passed
@github-project-automation github-project-automation bot moved this from In review to Done in OPEA Apr 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mkbhanda mkbhanda mkbhanda left review comments

Copilot code review Copilot Copilot left review comments

@ftian1 ftian1 ftian1 approved these changes

@chensuyue chensuyue chensuyue approved these changes

@kding1 kding1 Awaiting requested review from kding1

@hshen14 hshen14 Awaiting requested review from hshen14

@preethivenkatesh preethivenkatesh Awaiting requested review from preethivenkatesh preethivenkatesh is a code owner

@chickenrae chickenrae Awaiting requested review from chickenrae chickenrae is a code owner

@tomlenth tomlenth Awaiting requested review from tomlenth

@ashahba ashahba Awaiting requested review from ashahba

+4 more reviewers

@eero-t eero-t eero-t requested changes

@louie-tsai louie-tsai louie-tsai approved these changes

@rbrugaro rbrugaro rbrugaro approved these changes

@Yu-amd Yu-amd Yu-amd approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

documentation Improvements or additions to documentation v1.3

Projects

OPEA
Status: Done

Milestone

v1.3

Development

Successfully merging this pull request may close these issues.

9 participants

@joshuayao @Yu-amd @mkbhanda @eero-t @ashahba @ftian1 @louie-tsai @chensuyue @rbrugaro